Oscillatory correlation of delayed random walks 



Toru Ohira 
Sony Computer Science Laboratory 
3-14-13 Higashi-gotanda, 
Tokyo 141, Japan 
ohira@csl.sony.co.jp 

Sony Computer Science Lab Technical Report: SCSL-TR-96-014 



Abstract 

We investigate analytically and numerically the statistical properties of a random walk model with 
delayed transition probability dependence (delayed random walk). The characteristic feature of such a 
model is the oscillatory behavior of its correlation function. We investigate a model whose transient 
and stationary oscillatory behavior is analytically tractable. The correspondence of the model with a 
Langevin equation with delay is also considered. 

Noise and correlative effects (memory) are two elements which are associated with many natural systems. 
In physics, two main approaches have been developed to study such systems with noise and memory. One 
approach is formulating the model in physical space with a differential equation of motion such as the 
"generalized Langevin equation" jij || . The other is to formulate a model in probability space as a non- 
Markovian problem as in the "generalized master equation" approach ||. These two avenues have been 
developed and applied to various problems in physics. Examples include studies on the Alder- Wainwright 
effect j|, spin relaxation ||, and driven two- level atoms Q. 

The delayed stochastic system we discuss here can be viewed as a special case, where only a single 
(memory) point at a fixed time interval in the past has influence on the current state of the system. Research 
of such systems, particularly those with no noise, has been carried out in fields of mathematics 0, biology^, 
artificial neural network^), electrical circuits |l(J, as well as in physics JTJJ. Models with both noise and delay 
have also been considered numerically |l2) and analytically as an extention of the Langevin equation [[L^]. 
These works represent approaches and formulations in physical space. For the probability space approach, 
"Delayed random walk" is recently proposed jljj and has been applied to model human posture controls jl5|] . 
However, an analytical understanding of this random walk is yet far from being complete. 

The main theme of this paper is to increase the analytical understanding of the behavior of a delayed 
random walk model. The oscillatory correlation function is found to be associated with delayed random 
walks |TJ, . We show here that such oscillatory behavior of the of the correlation function is analytically 
tractable. From the study of random walks point of view, this delayed random walk model provides an 



example whose correlation function behaves differently compared to commonly known random walks with 
memory, such as self-avoiding, or persistent walks p!7[ . In addition, we note that oscillatory or chaotic 
behavior associated with delays are generally difficult to analyze]!^]. Hence, this model also serves as one 
of the rare analytically tractable examples among models with delay. 

We consider a random walk which takes a unit step in a unit time. The delayed random walk we start 
with is an extension of a position dependent random walk whose step toward the origin is more likely when 
no delay exists. Formally, it has the following definition: 
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where the position of the walker at time t is X t , and P(X tl = U\) X t2 = 112) is the joint probability for the 
walker to be at ui and 112 at time t\ and t 2 , respectively. f(x) and g{x) are transition probabilities to take 
a step to the negative and positive directions respectively at the position x. In this paper, we further place 
the conditions: 

f(x)>g(x) (x>0), f(-x)=g(x) (Vx). (3) 

These conditions make the delayed random walks symmetric with respect to the origin, which is attractive 
without delay (r = 0). 

We now proceed to obtain a few properties from this general definition. By the symmetry with respect 



to the origin, the average position of the walker is 0. This symmetry is further used to inductively show |18 
in the stationary state (t — > 00) that 

P(X t+1 =n-X t = n + l) = P(X t+ i =n+l;X t = n). (4) 

We derived the stationary probability distribution for the previously discussed delayed random walk model 
using this property p| . Also, the multiplication of Eq. (|l|) for the stationary state by cos(cm) and summation 
over n and s yields for the generating function: 

(cos(aXt)} = cos(a)(cos(aX t )) + sm(a)(sm(aX t ){f(X t _ T ) - g(X t - T )}) (5) 

In particular, we have a following invariant relationship with respect to the delay. 

\ = {X t {f{X t _ T )-g{X t _ T )}) (6) 

This invariant property is used below. 

We will consider a specialized model for the rest of this paper [|lj|. We define f(x) and g{x) as 

f{x) = \(l + 2d) (x>a), \{l+(3x) {-a<x<a), i(l - 2d) [x < -a), 



g(x) = -(l-2d) (x>a), -(1 - (3x) (-a<x<a), \{l + 2d) [x < -a). 



(7) 
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Physically, this model implies that when r = the transition probability for the walker to move toward the 
origin increases linearly at a rate of (3 = d/a as the distance increases from the origin up to the potition 
a after which the transition probability is held constant. We assume that with sufficiently large a, we can 
ignore the probability for the walker to be outside of the range (-a, a). 

Then, the previous invariant relation in Eq. (^|) becomes the following with this model: 

(X t Xt- r ) = K(t) = ±. (8) 

This invariance with respect to r of the correlation function with r steps apart is a simple characteristic 
of this delayed random walk model. This property is a key to obtaining the analytical expression for the 
correlation function, which we now turn our attention. 

For the stationary state and < u < r, the following is obtained from the definition (|l|). 

P(X t = n;X t _ u = l) = ^g(s)P(X t = n-l;X t _ {u _ 1) =l;X t _ T = s) 

S 

+ ^f(s)P(X t = n+l;X t _ iu _ 1) =l;X t _ T = s) (9) 

s 

We can derive the following equation for the correlation function by multiplication of this equation by nl 
and summing over. 

K(u) = K(u- 1) -(3K{t+ 1 -u), (0<u<r). (10) 
A similar argument gives for r < u, 

K (u) = K (u - 1) - (3K (u - 1 - r), (r < u). (11) 

Equations ( |l0| ) and ([ll]) can be solved explicitly using (|^). In particular, for < u < r we obtain 

(m\ - m^T 1 ) - {m u _ - mT 1 ) 1 {m\ - mV) 



K{u) = K(0)- 



m + — rri- 2 m + — m_ 
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m± = [l-^)±^^~A (12) 

For r < u, it is possible to write K(u) in a multiple summation form, though the expression becomes rather 
complex. For example, with r < u < 2r, 

K( u ) — ~ ft K ® ( 13 ) 
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where K(i) summed is given by the equation (p~3) 
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The behavior of the correlation function is shown in Fig. 1. As we increase r, oscillatory behavior of 
the correlation function appears. The decay of the peak envelope is found numerically to be exponential. 
The decay rate of the envelope for the small u is approximately 1/ (2K(0)). Also we note the mean square 
postion (K(0)) increases with increasing delay r. 
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Figure 1: Stationary correlation function K(u) from simulations (dots) as a function of steps u with varying 
r compared with the analytical solution obtained in the text (line). The parameters are set as a = 50, d = 0.4, 
and t = (a)10, (6)40, (c)60, (d)80. The simulation performed random walks of 6000 steps starting from the 
origin. The position data after 4500 steps are used to compute the correlation and averaged over 10,000 
trials. 

Analysis of the correlation function for the transient state can be done in the similar argument as in the 
stationary state. We can derive the set of coupled dynamical equations as follows: 

K(Q,t+l) = K(0,t) + l-2/3K(r,t) 

K(u,t+1) = K(u- l,t) -0K(t - (u - l),t + 1 - u), (1<u<t) 

K(u,t+1) = K(u-l,t)-0K((u-l)-T,t + l-u), (u>t) (14) 

For the initial condition, we need to specify the correlation function for the interval of initial r steps. Let 
us consider a random walk, which is held at the origin before it begins to take a steps, thus performing a 
homogeneous random walk for the steps (1,t). This translates to the initial condition for the correlation 
function as 

K(u, t)=t-u (0 < u < t). (15) 

The solution can be iteratively generated for Eq. (|l4|) given this initial condition. We have plotted some 
examples for the dynamics of the mean square displacement K(0) in Figure 2. Again, the oscillatory behavior 
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Figure 2: Examples of dynamics of the mean square position (X 2 ) = K(0) with varying delay r. The 
data is from simulations (dots) averaged over 10,000 trials, and from the analytical solutions (line). The 
parameters are set as a = 50, d = 0.45, and r = (a)20, (6)40, (c)60. 



arises with increasing t. Hence, in the model discussed here the oscillatory behavior with increasing delay 
appears in both its stationary and transient states. 

Let us now briefly discuss relationship of this model to the Langevin equation with delay: 

±X t = -0X t _ T + Z t , = «(<i-ta). (16) 

This Langevin equation is a special case of the equation considered in It should be noted that the 

equation is normalized with the "width" of the noise It has been shown that: 

(1) the equation is stationary if and only if r < 

(2) The stationary correlation function K(r) = (X t X t _ r ) has the following form when r < r: 

K(r) =if(0)cos(/3r)-ism(/H K(0) = (17) 
When (3 << 1 (or a » d), the delayed random walk model approximately corresponds to this Langevin 



equation with delay. In particular, we can obtain Eq. (|17| ) from the result (12) obtained for the delayed 
random walk, by expanding in small (3. 

Some points of discussion are now in order. The first point is how this model is placed in relation to 
other models with noise and delay (or memory, to be more general). In particular we note that the Langevin 
equation discussed here is not a special case of the generalized Langevin equation which is consistent with the 
fluctuation-dissipation theorem. As argued in M for the generalized Langevin equation, the noise term needs 
to be "colored" in equation (|l6|) for the consistency. Investigation of the colored noise case in its relation to 
delayed random walks as well as further studies of the correspondence of dynamical aspects of ([!]) and ( filj| ) 
are currently underway. Finally, we ask what the possible applications are of delayed random walks. As 
mentioned before model with a different transition property has been applied [ fl4"| to describe the qualitative 
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statistical behavior of the center of gravity in a human posture control experiment |15| . Also, oscillatory 
correlation functions appear in such numerical studies of phase separation dynamics under stirring ]2(| and 
of response dynamics of neural recepter cell syncytium pl| . Applications or relations to these and other 
systems are currently being sought and considered. 

The model provided here is simple, yet has shown some characteristics of systems with noise and delay. 
It is hoped that further investigation of this and extended delayed random walks will provide us deeper 
understanding of delayed stochastic systems. 

The author would like to thank Drs. Y. Okabe and K. Umeno for discussions, and J. Milton and M. 
Mackey for suggestions of references. 
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